Significance tests for the evaluation of ranking methods
نویسنده
چکیده
This paper presents a statistical model that interprets the evaluation of ranking methods as a random experiment. This model predicts the variability of evaluation results, so that appropriate significance tests for the results can be derived. The paper concludes with an empirical validation of the model on a collocation extraction task.
منابع مشابه
RRLUFF: Ranking function based on Reinforcement Learning using User Feedback and Web Document Features
Principal aim of a search engine is to provide the sorted results according to user’s requirements. To achieve this aim, it employs ranking methods to rank the web documents based on their significance and relevance to user query. The novelty of this paper is to provide user feedback-based ranking algorithm using reinforcement learning. The proposed algorithm is called RRLUFF, in which the rank...
متن کاملبررسی تاثیر ادغام افقی برنامه کارآموزی روی برخی از شاخص‌های آموزشی در دانشگاه علوم پزشکی زنجان
Normal 0 false false false MicrosoftInternetExplorer4 /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal" mso-tstyle-rowband-size:0 mso-tstyle-colband-size:0 mso-style-noshow:yes mso-style-parent:"" mso-padding-alt:0cm 5.4pt 0cm 5.4pt mso-para-margin:0cm mso-para-margin-bo...
متن کاملChoosing weights for a complete ranking of DMUs in DEA and cross-evaluation
Conventional data envelopment analysis (DEA) assists decision makers in distinguishing between efficient and inefficient decision making units (DMUs) in a homogeneous group. However, DEA does not provide more information about the efficient DMUs. One of the interesting research subjects is to discriminate between efficient DMUs. The aim of this paper is ranking all efficient (extreme and non-ex...
متن کاملEvaluating Optimal Anti-Desertification Alternatives, Using Special Vector Technique and Bernardo Ranking Model
Introduction: Desertification is the process of ecological and biological reduction of land potential in a natural or unnatural way, mainly affecting arid regions. Moreover, it decreases land efficiency with increasing acceleration. Land resources and human populations exposed to desertification and land destruction are prone to various threats, including loss of land productivity, food insecur...
متن کاملA hybrid multicriteria approach for performance evaluation: the case of a holding company
In today’s competitive business situation, performance evaluation of firms is an extremely important concern of all the people who are typically stakeholders of the business game. In case of holding companies, this is a more important issue since the parent firm must permanently control the situation of its subsidiaries in their sectors to make appropriate investment decisions. This paper...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004